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Final  Technical  Report  to  the  U.S.  Army  Research  Office  on 
Contract  No.  DAAG29-85-K-0 1 38 


1.  Summary .  This  contract  was  entitled  "Parallel  and 
distributed  computing".  It  provided  $46,000  in  partial 
support  of  the  yearlong  program  on  Computational  Complexity 
held  at  the  Berkeley  Mathematical  Sciences  Research  Institute 
during  1985-86.  This  was  combined  with  a  similar  grant  for 
$92,000  from  the  Air  Force  Office  of  Scientific  Research  and 
with  funding  of  MSRI  from  the  National  Science  Foundation  to 
budget  the  total  program  on  Computational  Complexity  at 
approximately  $600,000. 

Intially,  the  co-principal  investigators  were 
Richard  Karp  and  Calvin  Moore.  When,  on  July  1,  1985, 
Professor  Moore  left  his  post  as  Deputy  Director  of  MSRI  to 
become  a  Vice-President  of  the  University  of  California 
system,  Irving  Kaplansky  (the  current  Director  of  MSRI) 
replaced  him.  Professor  Karp  provided  the  scientific 
direction  and  Professor  Kaplansky  the  administrative  support. 

David  Shmoys  and  Umesh  Vazirani  were  postdoctoral 
fellows  supported  by  the  contract;  Leslie  Valiant  of  Harvard 
University  was  a  senior  visitor  for  four  months  (April  15  - 
July  15,  1986). 

From  May  19  to  May  23,  1986  MSRI  hosted  a  Workshop 
on  Parallel  and  Distributed  Computing,  supported  by  the  Army 
contract  and  the  Air  Force  grant. 


2 .  Report  on  the  Scientific  Work. 


Leslie  Valiant 

Leslie  Valiant  worked  on  the  problem  of  inferring 
a  rule  or  computer  program  from  examples  of  its  behavior.  The 
problem  has  applications  in  fields  such  as  artificial 
intelligence  and  pattern  recognition.  The  mathematical 
problem  is  to  identify  classes  of  rules  or  programs  that  can 
be  inferred  in  a  provably  convergent  sense  from  reasonably  few 
examples.  At  the  MSRI  Workshop  on  Complexity  of  Parallel  and 
Distributed  Computation  he  presented  a  talk  entitled  "Learning 
Algorithms  for  Connectionist  Models".  He  also  spoke  at  UC 
Irvine  on  "A  Theory  of  the  Learnable". 
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David  ;  noys 

David  Shmoys  investigated  protocols  for  shared 
decision  making  in  a  distributed  network  of  processors,  some 
of  which  may  be  faulty.  Some  of  this  work  was  presented  in  C. 
Dwork,  D.  Shmoys  and  L.  Stockmeyer ,  "Flipping  Persuasively  in 
Constant  Expected  Time,"  Proceedings,  27th  IEEE  Symposium  on 
Foundations  of  Computer  Science,  pp.  222-232,  1986. 


Umesh  Vazirani 


Umesh  Vazirani  in  joint  work  with  Vi  jay  Vazirani, 
investigated  the  computation  power  of  randomized  algorithms 
when  the  generator  of  random  bits  is  imperfect,  and  may  even 
be  controlled  by  an  intelligent  and  devilish  adversary.  It  is 
only  required  that,  for  every  bit  generated,  the  probability 
of  generating  a  1  is  uniformly  bounded  away  from  both  zero  and 
one.  The  main  result  of  this  investigation  is  that  any 
problem  that  can  be  solved  in  polynomial  time  using  a  perfect 
generator  of  unbiased,  independent  bits  can  also  be  solved  in 
polynomial  time  using  an  imperfect  generator. 

In  the  reference  cited  below,  Vazirani  and  his  co-authors 
developed  an  efficient  randomized  algorithm  for  constructing  a 
maximum  matching  in  a  graph. 

K.  Mulmuley,  U-V.  Vazirani  and  V.V.  Vazirani,  "Matching 
is  as  Easy  as  Matrix  Inversion",  MSRI  Preprint  06318-86. 


3 .  Report  on  the  Workshop. 

A  workshop  on  the  complexity  of  parallel  and 
distributed  computation  was  held  at  MSRI  from  May  19  to  May 
23,  1986.  The  workshop  had  21  speakers  and  141  participants? 
their  interests  ranged  from  practical  questions  about  the 
architecture  of  parallel  and  distributed  systems  to  highly 
theoretical  questions  about  the  complexity  of  parallel 
computation.  A  panel  discussion  was  held  on  the  topic 
"Bridging  the  Gap  Between  the  Theory  and  Practice  of  Parallel 
and  Distributed  Computing". 


The  main  focus  of  the  workshop  was  a  set  of  mathematical 
and  algorithmic  issues  that  underlie  the  efficient  use  of  the 
massively  parallel  computers  that  are  just  beginning  to  come 
into  use.  Several  of  the  lectures  were  concerned  with 
efficient  algorithms  for  such  computers.  Other  lectures  were 
concerned  with  the  problems  of  synchronization,  load-sharing, 
and  communication  between  processors  in  such  systems.  A  third 
major  theme  was  the  reliable  operation  of  such  systems  in  the 
presence  of  faulty  processors. 

The  total  budget  for  the  workshop  was  $18,000,  of  which 
$2,850  came  from  the  Army  contract,  and  $15,150  from  the  Air 
Force  grant. 

The  participants  supported  by  the  Army  contract  were  as 
follows : 


Dharma  Agrawal 

$350 

Baruch  Awerbuch 

650 

Gianfranco  Bilardi 

650 

Mo-Suk  Chow 

350 

Patrick  Dymond 

400 

Charles  Seitz 

450 

$2, 850 

Appended  as  attachments  to  this  report  are  the  widely 
distributed  poster  for  the  workshop,  the  complete  list  of 
participants,  and  the  program. 
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4 .  Financial  Report. 

Salary  (Valiant)  $19,000 

Postdoctoral  fellowships: 


Shmoys 

8,  500 

Vazirani 

8,  500 

Travel  allowances: 

Shmoys 

656 

Vazirani 

564 

Workshop 

2,850 

Fringe  Benefits 

900 

Health  Insurance  (Vazirani) 

780 

Telephone 

760 

Supplies,  preprints 

1,240 

Technical  typing 

1 , 300 

Computer  charges 

950 

$46,000 


Workshop  on 

PARALLEL  AND  DISTRIBUTED  COMPUTATION 

May  19-23, 1986 
at  the 

MATHEMATICAL  SCIENCES  RESEARCH  INSTITUTE 
BERKELEY,  CALIFORNIA 

As  part  of  its  yearlong  1985-86  program  on  Computational  Complexity,  the  Mathematical 
Sciences  Research  Institute  will  host  a  one-week  workshop  on  the  complexity  of  parallel  and  dis¬ 
tributed  computation.  May  19-23,  1986.  The  organizing  committee  consists  of  R.M.  Karp  (chair¬ 
man),  H.T.  Kung,  Michael  Rabin,  and  J.T.  Schwartz.  One  of  the  principal  aims  of  the  workshop 
is  to  bring  mathematicians  and  computer  scientists  working  on  the  theoretical  aspects  of  these 
subjects  into  contact  with  numerical  analysts  and  computer  architects  involved  in  the  design  and 
use  of  parallel  and  distributed  computer  systems.  M<yor  topics  addressed  at  the  workshop  will 
include,  complexity  of  parallel  computation,  combinatorial  and  numerical  parallel  algorithms, 
realization  of  parallel  algorithms  in  hardware,  abstract  models  of  parallel  computation,  architec¬ 
ture  of  parallel  computers,  concurrency  control,  randomization  in  parallel  and  distributed  com¬ 
puting.  routing  algorithms,  and  fault-tolerant  computation  in  distributed  systems. 

In  addition  to  the  program  committee,  the  following  have  been  invited  to  participate: 


R.  Anderson 

D.  Hillis 

E.  Mayr 

L.  Synder 

B.  Awerbuch 

E.  Kaltofen 

G.  Miller 

G.W.  Stewart 

A.  Borodin 

R.  Kannan 

C.  Moler 

L.  Stockmeyer 

T.  Chan 

D.  Kozen 

K.  Mulmuley 

H.  Stone 

A.  Chandra 

D.  Kuck 

JOliger 

R.  Strong 

M.  Chandy 

R.  Ladner 

V.  Pan 

R.  Tarjan 

R.  DeMillo 

L.  Lampxin 

C.  Papadimitriou 

C.  Thompson 

C.  Dwork 

E.  Lawler 

G.  Pfister 

J.  Ullman 

P.  Dymond 

F.T.  Leighton 

N.  Pippenger 

E.  Upfal 

F.  Fich 

C.  Leiserson 

F.  Prepara ta 

L.  Valiant 

M.  Fischer 

R.  Lipton 

J.Reif 

U.  Vazirani 

Z  Galil 

M.  Luby 

W.  Ruzzo 

V.  Vazirani 

J  von  zur  Gathen 

F.  Luk 

C.  Seitz 

U.  Vishkin 

W.M.  Gentleman 

N.  Lynch 

D.  Shmoys 

A.  Wigderson 

J.  Halpem 

G.  Mago 

M  Stpser 

A.  Yao 

The  workshop  will  be  held  at  the  Institute’s  new  building  at  1000  Centennial  Drive.  Shuttle  bus 
service  will  be  provided  from  the  central  campus  area. 

The  mathematical  sciences  community  is  warmly  invited  to  attend.  Additional,  more  detailed 
information  will  be  sent  to  people  indicating  a  desire  to  come  to  the  workshop.  There  will  be  a 
limited  amount  of  money  available  to  provide  partial  support  for  people  wishing  to  attend  and 
participate.  New  and  recent  Ph.D.’s  are  encouraged  to  apply.  Requests  for  financial  support 
should  be  received  by  April  I,  1986.  Address  inquiries  concerning  the  workshop  to  Program 
Commit  tee,  Parallel  and  Distributed  Computing.  Mathematical  Sciences  Research  Institute,  1000 
Centennial  Dri\e.  Berkeley,  California  94720.  Funding  for  the  conference  is  provided  by  the 
Army  Research  Office  and  the  Air  Force  Office  of  Scientific  Research,  in  cooperation  with  the 
Office  of  Naval  Research. 
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WORKSHOP  ON 

COMPLEXITY  OF  PARALLEL  &  DISTRIBUTED  COMPUTATION 

May  19-23,  1986 

(All  sessions  will  be  held  in  the  MSRI  Lecture  Hall.) 
Monday,  May  19 


8:30  - 

9:30 

Arrival  of  Participants 

9:30  - 

9:40 

Opening  of  the  Workshop 

9:40  - 

10:30 

Richard  Anderson,  MSRI 

A  Random  NC  Algorithm  for  Depth-First  Search 

10:40  - 

11:30 

Uzi  Vishkin,  Tel  Aviv  University 

On  Methods  for  Designing  Parallel  Algorithms 

12:30  - 

2:00 

Lunch  Break 

2:00  - 

2:50 

John  Reif,  Harvard  University  and  MSRI 

Efficient  Parallel  Algorithms  -  Theory  and  Practice 

3:15  - 

4:00 

Tea 

4:00  - 

4:50 

Gary  Miller,  University  of  Southern  California 
Workload  Balancing  in  the  Design  of  Processor- 
Efficient  Parallel  Algorithms 

Tuesday,  May  20 


9:00  - 

9:50 

Gianfranco  Bilardi,  Cornell  University 
Bitonic  Sorting  in  0  ( log  n)  Time  with  0( 
Processors 

10:00  - 
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Nicholas  Pippenger ,  IBM  Almaden  Research 
Parallel  Comparison  Problems 

10:50  - 

11  :  30 

Coffee  Break 

11:30  - 

12:20 

Ketan  Mulmuley,  University  of  California 
Parallel  Computation  in  Linear  Algebra 

12:20  - 

2:00 

Lunch  Break 

2:00  - 

2:50 

Franklin  Luk ,  Cornell  University 

Parallel  Algorithms  for  Signal  Processin> 

3:15- 

4:00 

Tea 

4:00  - 

4  :  50 

Gilbert  Stewart,  University  of  Maryland 

Determinacy  -  Its  Uses  and  Limitations 


6:  30 


Heyns  Room,  Faculty  Club 
Reception  for  all  participants 
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Wednesday.  May  21 


9:00  -  9:50 


10:00  -  10:50 


10:50  -  11:30 


11:30  -  12:20 


12:20  -  2:00 


2:00  -  2:50 


3:15  -  4:00 


4:00  -  4:50 
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11:30  -  12:20 
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Joseph  Halpern,  IBM  Almaden  Research  Center 
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Coffee  Break 

Silvio  Micali,  MIT 

How  to  Compile  Protocols  for  Reliable  Players  to 
Equivalent  Fault-Tolerant  Protocols 

Lunch  Break 

Eli  Upfal,  IBM  Almaden  Research  Center 

On  the  Relation  Between  Desirable  and  Feasible 

Models  for  Parallel  Computation 


Michael  Rabin,  Harvard  University,  Hebrew  University 
and  MSRI 

Randomized  Synchronization  Primitives  for  Parallel 
Computers 


Larry  Snyder,  University  of  Washington 
Type  Architectures 

Charles  Seitz,  California  Institute  of  Technology 
Low  Latency  Message-Passing  Techniques  for 
Concurrent  Computers 

Coffee  Break 

Charles  Leiserson,  MIT 

VLSI  Theory  and  its  Relation  to  Parallel 
Super  computing 

Lunch  Break 


V  Si 


$* 


2:00  -  3:15 


3:15  -  4:00 

4:00  -  5:00 

Friday,  May  23 


Panel  Discussion:  Closing  the  Gap  Between  the 
Theory  and  Practice  of  Parallel  and  Distributed 
Computation 

Richard  Karp,  University  of  California  at  Berkeley 
and  MSRI 
Charles  Leiserson,  MIT 

Michael  Rabin,  Hebrew  University,  Harvard  University 
and  MSRI 

Charles  Seitz,  California  Institute  of  Technology 
Larry  Snyder,  University  of  Washington 

Tea 

Continuation  of  Panel  Discussion 


9:00 

-  9:50 

Avi  Wigderson,  MSRI 

Lower  Bounds  in  Parallel  Computation 

10:00 

-  10:50 

Jeffrey  Ullman,  Stanford  University 

Parallel  Complexity  of  Logic  Programs 

11:00 

-  11:50 

Leslie  Valiant,  Harvard  University  and  MSRI 
Learning  Algorithms  for  Connectionist  Models 

END  OF  WORKSHOP 


PLEASE  POST 


I'ltV 


